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The briefing oflicer was re])orting a photo reconnaissance mission,* 
Pointing to the .map, he made three statements; 

. 1. “And.at this location there is a ne,\y airfielcL [He could have 

located it. to the second on a larger map..] . Its longest run- -. 
way is 10,000 feet.” 

2. “It is almost certainly a military airfield.” 

■ : 3. “The. tcfrain .is such that ■ the Blanks could easily lengthen the , 
runways, otherwise improve the facilitie.s, and incorporate thi.s 
field into theii' system of strategic staging bases. It is possible 
that they will.” Or, more claringh-, “It would be logical for 
: them to do- this .and sooner or later they probably will.” „ . ... 

The above are typical of three kinds of statements which populate ' 
the literature of all substantive intelligence. The first is as' close as 
one can come to a statement of indisputable fact. It describes some- 
thing knowable and known with a high degree of certainty. The 
reconnaissance aircraft’s position was known with precision and its 
camera reproduced almost exactly what was there. 

Estimative Uncertainty 

The second is a judgment, or estimate. It describes something which 
is knowable in terms of the human understanding but not precisely 
known by the man who is talking about it. There is strong evidence 
to sustain his judgment: the only aircraft on the field are military air- 
craft, many are parked in revetted hard-stands, the support area ha.s 
all the characteristics of similar known military installations, and so 
on. Convincing as it is, this evidence Is circumstantial. It cannot 
justify a flat assertion that this is a military aii-field. It makes the 
case; ’say, 90 percent of the way." And sorne sort of verbal qualifier" 


‘ Ttii.s particular briefing officer was not the photo-iiitcrprcter. See page 61 
for tlie special language of P/ls. 
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is necessary to show that the case is a 90-percenter, not a 100, This 
is why the briefer said ‘'almost certainly.” 

The third statement is another judgment or estimate, this one made 
almost without any evidence direct or indirect. It may be an estimate 
of something tliat no man alive can know, for the Blanks may not yet 
have made up their minds whether to lengthen the runways and build 
up the base. Still the logic of the situation as it appears to the briefer 
permits him to launch himself into the area of the literally unknowable 
and make this estimate. He can use possible to indicate that nmway 
extension is neither certain nor impossible, or he can be bolder and use 
probably to designate more precisely a degree of likelihood, a lower 
one than he had attached to his estimate regarding the chMactef of 
the airfield. 

Generally speaking, the most important passages of die literature of 
substantive intelligence contain far more statements of the estimative 
types two and three thian of the factual type one. This is the case 
because many of the tilings you most wish to know about the other 
man are the secrets of state he guards most jealously. To the extent 
his security measures ^vork, to that extent your knowledge must be 
imperfect and your stEitements accordingly qualified by designators 
of your uncertainty. Slimple prudence requires the qualifier in any 
type-three statement to show a decent reticence before the Unknowable. 

Concern over these qualifiers is most characteristic of that part of the 
intelligence production business known as estimates. This is no small 
recondite compartment; it extends to almost every comer of all in- 
telligence research woilc, from the short appraisals or comments of 
a reports officer to th(; full-dress research study of the political or 
economic analyst. Practically all substantive intelligence people con- 
stantly make estimates,, The remarks that follow are generally ad- 
dressed to all these people and their readers, but most especially are 
they addressed to that particular institution of the estimating busi- 
ness knovra as the National Intelligence Estimate and its audience. 

The NIE, taking into account the high echelon of its initiators, pro- 
ducers, and consumers, should be the community’s best effort to deal 
with the relevant evidence imaginatively and judiciously. It should 
set forth the community’s findings in such' a way as to make clear to 
the reader what is certain knowledge and what is reasoned judgment, 
and vdthin this large realm of judgment what varying degrees of 
certitude Ue behind each key statement Ideally, once the commu- 
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nity has made up its mind in this matter, it should be able to choose a 
word or a phrase ^vhich quite accurately describes the degree of its 
certainty; and ideally, exactly this message should get through to 
the reader. . . . 

It should not come as a surprise that the fact is far from the ideal, 
that considerable difiBculty attends both the fitting of a phrase to 
the estimators’ meaning and the extracting of that meaning by the 
consumer. Indeed, from the vantage point of almost fourteen years 
of experience, the diflBculties seem practically insurmountable. The 
why and wherefore: of this particular area of semantics is the subject 
of this essay. 

Let me begin with a bit of history.® 

Early Brush with Ambiguity 

In March 1951 appeared NIE 29—51, “Probability of an Invasion of 
Yugoslavia in 1951.” The following was its key judgment, made in 
the final paragraph of the Conclusions: “Although it is Impossible to 
determine which course the Kremlin is likely to adopt, we believe 
that the extent of Satellite military and propaganda preparations in- 
dicates that an attack on Yugoslavia in 1951 should be considered a 
serious possibility." (Emphasis added.) Clearly this statement is 
either of type two, a knowable thing of which our knowledge was 
very imperfect, or of type three, a thing literally unknowable for the 
reason that the Soviets themselves had not yet reached a- binding 
decision. Whichever it was, our duty was to look hard at the situa- 
tion, decide how likely or unlikely an attack might be, and having 
reached that decision, draft some language that would convey to the 
reader our exact judgment. 

The process of producing NIEs then was almost identical to what 
it is today. This means that a draft had been prepared in the Office 
of National Estimates on the basis of written contributions from the 
lAC ® agencies, thiat a score or so of Soviet, Satellite, and Yugoslav 
experts from the intelligence community labored over it, and that an 
all but final text presided over by the Board of National Estirnates 
had gone to the Intelligence Advisory Committee. There the lAC 

•Harry H. Ransom’s Central Intelligence and National Security (Cambridge, 
Mass., 1958) carries on pp. 196-7 a bob-tailed and somewhat garbled version of it. 

•Intelligence Advliory Committee, USIB’s predecessor. 
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members, with the DCI in the chair, gave it its final review, revision, 
and approval. 

As is quite obvious from the sentence quoted above, Soviet and 
Satellite intentions with respect to Yugoslavia were a matter of grave ' 

concern in the high policy echelons of our- government. The State 
Departments Policy Planning Staff was probably the most important 
group sei/nd of the problem. Its chairnran arid members. jead NI^.. . 

29-1^1 with the sort of cohccntfatioii intelligene’e producers can only 
hope their product will command. 

.A few days after the estimate appeared, I was in informal con- ■ ■ 
versation with the Policy Planning Staff's- chahman. , We spoke of 
Jugoslavia and the estimate. Suddenly ho said, “By the way', what 
did you people mean by the expression 'serious possibility? What 
kind of odds did you have in mind?”, P told him that my personal 
estimate was on the dark side, namely that the odds were around 
65 to 35 in favor of an attack. Pie was somewhat jolted by' tliis; he 
and his colleagues had read “serious- possibility” to mean odds very 
considerably' lower. Understandably' troubled by this want of com-;- 
munication, I began asking my own colleagues on the Board of National 
Lstimates what odds they had had in mind when they agreed to that , 

wording. It was another jolt to find that each Board member had | 

had somewhat different odds in mind and the low man was thinking I 

of about 20 to 80, the high of SO to 20. 'lire rest ranged in between. I 

Of my colleagues on the Board at least one — maybe more — shared 

Pie and 25X1 A9a 

members 

who had worked over the estimate had failed to communicate with 
each other than by the Board’s failure to communicate with its audi- 
ence. This NIEl was, after all, the Nventy'-ninth that had appeared 
since General Smith had established the Office of National Estimates. 

Had Board members been seeming to agree on five month’s worth of 
estimative judgments rvith no real agreement at all? Was this the 
with ^all, others who participate, d— ONE staffejcs.and lAG -repre- ■ . 
sentatives, and even lAC members themselves? Were the NIEs dotted 
with “serious possibilities” and other expre.ssions that meant very dif- 


my concern. My most obvious co-worrier 
1 were shaken perhaps more by the realization tliat Board 


25X1 A9a 

• . ..-f.-'U,- 


one of the original eight members of the Board of National 
Estimates, a lawyer by trade, and a gifted scftianticist by avocation. ' Some will 
remember hin,i for his elegant aud precise writing; none will forget, his ccccntricitieSt , 
He was the" man-' who' alwaVs'wdr'e his hat in flrb house.' ' ' 
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ferent things to botli producers and readers? What were we really 
trying to say when ^^’c \srote a sentence such as this? 

Wliat we were trying to do was just what my Policy Planning friend 
had assumed, namely to quote odds on this or that being the case or 
taking place in the future. There is a language for odds; in fact 
there arc two— the precise mathematical language of the actuary or 
the race track bookie and a less precise though useful S’Crbal equiva- 
lent. We did not use tlie numbers, however, and . it appeared that 
. . we were misusing the, words.' 

The No-Odds Possible . ■ , 

Our gross error in the Yugoslav estimate, and perhaps in its prede.- 
cessors, lay in our not having fully understood this particular part of 
25X1 A9a our task. As H^^^and I saw it the substantive stuff we had been 
dealing with had about ;'t certain elements of dead certainty: Stalin’ 
was in charge in the USSR, for e.xample. These, if relevant, we stated 
affirmatively or used imjilicdly as fact, ' There were also eiements of 
sheer- impossibility ■ (Yugoslavia was not going to crack off along its 
^ borders and disappear pliysically from tlie face.of.tlie earth); these 

■! ■ did not bother to .state at all. In between thescinatters of ccr-'' 

tainty and inipossibility lay the large area of the j^ossiblc. With 
respect lO the elements herein we could perceive some that were more ■ 
‘ likely to happen tlian not. some less likely. These were the elements 

upon which we could make an estimate, choosing some v/ord or phrase 
to convey our judgment that the odds were' such and such for or 
i against something coming to pass, 

j At the race track one might say; 

I Ihere arc ten hoiscs in the starting gate. It is possible that any one of 

i them will win — even the one witli three legs. 

But the odds (or cnanc:es) ogoinsi tlie three-logger are over«'helining, 

j Here, as in estimating Yugoslav developments, there is evidence 

■; to justify the citing of odds. But in the world that intelligence esti- 

mates try liardest to penetrate — a world of closed covenants secretly 
! . arrived at, of national business conducted behind walls of all but 

I impenetrable security, of skillfully planned deceptions, and so on-^' 

such evidence is by no means invariably at hand. In a multitude of 
the most important circurnst.ances — .situations you are duty bound to 
consider and report on- — about all you can say is that such and such 
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is neither certain to happen nor is its happening an impossibility. 
The short and propei' way out is to say that its happening is possible 
and slop there without any expression of odds. If you reserve the 
use of “possible” for this special-purpose — to signal something of 'high 
importance who.se chances of being or happening you cannot estimate 
wnth greater precision — hopefully you will alert your reader to some 
necessary contingency planning. (You may not if you have dulled 
him by citing a .lot of “possibles” of little real cpnscqueiice.) . 

If our gro.ss error lay iii not perceiving the GOiTCctness-^oc at airy 
rate the utility— of the above formulation, our. particular ’error lay in 
using, the word “possibility” with the- modifier “serious-.” and 

I ' felt that it was going to be difficult enough for the estimators to - 
communicate a sense of odds even if they stuck to a fairly rigorous' 
vocabulary; it was going to -be impossible if the vocabulary were 
permitted to become as sloppily impi ccise as in normal speech. \Ye 
had to have a -way of differentiating between tlio.se possible things 
’ahouH- which '^e could ihake a , statement, of likelihood and the. other 
possible things about which we could not. The first cardinal rule to 
emerge wa.s tl nrs, “The word .‘possible’ (. and its cognates ^ ), must not. be 
modified.” Tlie. urge to drop into ordinary usage and write “just pos- 
sible,” “barely po.ssible,” “a distinct [or good] possibility,” and so on 
must be suppressed. The whole concept of “possibility” as hero devel- 
oped .must stand naked of verbal modifiers.®' ■ ■■ , 


‘ See page 59. . 

'This usage is wholl)’ in accord vvith the findings of the lexicographers, who 
almost invariably assign it. the number one position. Furtlicr, it i.s readily under- 
stood and geneially employed by statisticians, scientists, and the like, who some- 
times define it as “non-j;ero probability.” This is much to ray taste. 

At the same lime ihi'i'e can be no question of tlie existence of a second usage, 
especially in tlie ordinary spoken word. The meaning here is most emphatically 
not tlie broad range of “non-zero probability,” but a variable low order of prob- 
ability, sa)' anywhere below 40 or 30 or 20 percent. Thus it would fall last in 
a scries that named descending odds: certain, probable, possible. When people 
• f- ; use. it ..to signify very }ow odds, for .'e.xample below -5 percent, tliey may say ''re-'- 
- motely possible” or any of its many cognates. This of course is not to my liking, 

but tlic intended meaning is clear. The .serious trouble comes when another 
group of.u.sers lifts the word out of its [lositioii in the cellar of odds and by 
the addition of augmenting adjectives makes it do. duty upstairs: "serious possi- 
bility,” "great possibility," "iiighly possible.” ' 



Approved For Release 2000/09/14 : C1A-RDP84B00506R0001 00070007'- 


25X1 A9a 



Approved For Release 2000/09/14 : CIA-RDP84B00506R0001 00070007-1 

Words of Probability 


An Odds 2'able. j 

.25X1AgaDncc^H "^nd I had decided upon this first cardinal rule we 
; turned t(^^WRments where likelihood couh/ be estimated. We began 

I to think in terms of a chart which would show the mathematical odds 

equivalent to words and phrases of probability. Our starter was a 
pretty complicated aflair. We approached its construction from the 
wrong end. Namely, we began with 11 words or phrases which 
seemed to convey a feeling of 11 diiTorent orders of probability and 
• ' ■■ ■ then ■ attached.' numerical, gdds. to.' them.- , At. opce .yim - pereeived our 
folly.. In the first place, given the inexactness of tlic intelligence 
■data we were working with,' the distinctions we made between one. 
set of odds and its fellows above aiid below- w'cre unjustifiably .sharp. 
And second, even if in rare cases you could arrive’ at such e.xact mathc- 
} , matieal odds, the verbal equivalent could not possibly convey that 

t- . .'exactne.ss.^ . The laudable precision would be lost on the readerv ' 

. So vve tried again, this time with only five gradations,- and beginning 
.with the. numerical odds.. The chart which emerged can be set dowTi 
in its classical sirnpli-city thus; 


Important note to consumers; You should be quite clear that when we say 
"such and such is unlikely” we mean that the chances of its NOT happening 
are in our judgment about tlrree to one. Another, and to you critically 
important, way of saying the same thing is that the chances of its HAPPEN- 
ING are about one in four. Thus if wc were to write, “It is unlikely that 
Castro will attempt to shoot down a U-2 between now and Novembet. 1965,”, 
we mean there is in our ' view '.around a 25-percent ' chance that ho will do 
just that. If tlic estiina.te wore to read, "It is almost certain Ca.slro will 
not . . wc would mean there was still an appreciable chance, say five 
percent or less, tlrat he would attempt the shoot-down. 



*; 0 
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100% Certainty 


93%, 

75%, 

■50%. 

30%, 

7%, 


give or take about 6% Almost certain 

give or take about 12% Probable 

give or take about 10% Chaiiccs about even 

give or take about 10% Probably not 

give or take about 5.% Almost certainly not 


0% Impossibility 
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Wc had some cliarts run up and had some discussions in the com- 
munity. There were those wlio thought the concept and the cliart 
a very fine thing. A retired intelligence professional thought well 
enough of it to put it into a book.'' CIA officers, addressing. War 
College audiences and the like, would sometimes flash a .slide and 
talk about it. A few copies got pasted on the walls of estimates offices 
in the community. Some people ,>veie sufficiently taken that they 
. ' . 'advocated- piittlhg it on the’ inside back cover of every NIE as a sort 

of sure-fire handv. tdossarv. ' ' . 

... ■ , . ■ There were also those who did not think about the idea at all, and . 

.■ 'dthers in opposition to it. Some ■fairly ' important people .who. had 
a professional stake in this kind of thinking never look the trouble 
to learn what it was all about. A good, many d.id take a little trouble 
and laughed;.' Still a third group found out all they needed to know 

■ and attacked the whole proposition from a hard semantic base point. 

, , , .Of these, more later, . ■■>. ,■• ’ 

■ In the face of this inertia and opposition and -ivith t1ic early dc- 

?5X1 gf Qj^iy sQpj ally,^H^^^^| 1 began backing away from 

bold forward positions. - I did .continue harassing actioris and in tho 
coarse of making a nuisance of myself to associates and colleagues did 
pick up some useful converts, but I dropped all thought of getting 
an agreed air-tight vocabulary of estimative expressions, let alone 
. I ■ reproducing • tlie chart in the rear of every NIE. ' With the jiassage 
of time it has appeared that the guerrilla strategy thrust upon me by 
! circumstance was the only one holding any chance of success. In 

• f almost fourteen years this article is my first serious and systematic 

; attempt to get the message across, and it probably would not have 

^5X1A9abeen written if had not consulled me about his foray 

into the same semantic problem. 

The Aesthetic Opposition 

What slowed me up in the first instance was the firm and reasoned 
i, ■ ..resistance .of some of my colleagues. Quite figuratively I ain going 




’ VVa.shington I’lntt, Stnilcgic Intelligence Production (N.Y., 1957). The chart 
appears bn tlie inside cover and again' on page 208-^not exactly as above but 
in full accord with niy principle.s. The trouble conics on pp. 209-210, whore 
General Piatt departs widely, and to me rcgrcttaljly, from my notion of legitimate 
■ syrionyrus. ' 

' Sec 'th'e next following article. ' • • ■ ,■ 
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to call tliem the “poets”— as opposed to the mathematicians in 
my circle of associates, and if the term conveys a modicum of dis- 
approbation on my part,' that is Avhat I want it to do. Their altitude 
toward the problem ol: communication seems to be fundamenta ty 
defeaUst. Tlicy appear to believe the most a writer can achieve when 
working in a speculative area of human affairs is communication in 
only the broadc.st general sense. If he gets the waong message across 
or no message at all- — vrell, that is life. 

: " Perhaps: I overstate the .poets’ defeatism. In any .case at least , one : 
of them feels quite strongly that my brief .for the “mathematieians ; 
is pretty' much nonsense. He has said that my likening rny side .to the 
mathematician’s is a yiboney; tliat I am in fact one witlv thc sociologists 
who try by artificial definitions to give language a .bpgus precision. 
He has gone on to stress the function of rhetoric and its importance. 
•And ho has been at some pains to- point out how. handy Pwould be 
• to use'- e.vpressions like “jtisc possible,"’ “may wellf and “doubtless 
as they are loosely used in conversation. Could there not be .an 

.. occasional telaxation of the rule? , .V;;' .- /. . /..v- ■ ‘'i' .'y r 

■' ' Suppose one wrote a sentence: “Khrushchev may ivell have had in 
the bacl< of his mind such and sucli, or indeed it i.s distiucthj possible 
■ that somebody bad just primed ]um. . . Now suppose you dJete 
the “well” and the “distinctly”; has anything been lost? There ^will 
be those who point out that “may tveU" and “distinctly possible” do 
conv'ey a flavor which is mi-ssing without them. Of course the ffavpi 
in question is the flavor of odds, communicated without quoting them. 
The poets would probably' argue that in a sentence of this sort tire 
introduction of airy of the terms for particular odds would make the 
WTitcr look silly. Everybody- knows that you could not have the evi- 
dence to sustain the use of, say, “probably” in these two instances. 
Hence you can only suggest odd.s by die use of the may well and 
“distinctly possible” .£.nd so say something without saying it, m short 
fudge it. The poets feel wounded when urged to delete the whole 
ambiguous sentence, arguing that this serves only to impo\crish the 
product. - They grov/; impatient when ^ou advocate dropping only 
the "well” and the “distinctly.” ' And as for your accusation of fudging, 
they generally counterattack, inviting you to write something that 

fudges nothing. • 
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There is a point which the poets can make with telling cfFect. It 
is that there are probaljly just as many reading poets as there are 
writing poets, and these arc going to be numb to the intended meaning 
of die ‘ mathematician” \rriter. If you wiite to give no more than just 
the general idea or general feel you may get through with great 
success. Per contra, if you break your heart in an endeavor to make 
l^yourself fully and precisely.ririderstood, you may not, ■ ■ ■ ■■. . 

I realize the truth in the above; I am not reconciled; I deplore it. 

The Growth of Variants 

Even if there had been, no poets it would have been an impractical 
idea to print a chart on the inside of the back page . of . each KTE ■ 
as a sort of glossary. To have used the one on page 55 and stuck to 
these words exclusively would have imposed intolerable restraints upon 
■tire prps,e. Even if it hacl, been desirable.it would have beeii’ impossible 
to enfoi'ce such rigidity. But this was really never at issue: from tlie 
start a number of perfectly legitimate synonyrns for the concept of j 
^possibility and a number for’ each of the five orders of likelihood were 
generally recognized, “ ■ ' 


’Some of these synonymous meanings are e.\'pressod in verb forms. Thus it 
is syntactically possible to use them- closely coupled to one of. the adverbial 
expressions of odds, e.g., “we believe it likely tliat . . or “we estimate it. is 
almost cei tain that such and such will not . . If w'e really mean to assign 
an odds value to these verb forms good usage would forbid tin's kind of doubling-, 
up. Mathematically, the probabilities would have to undergo a quite ridiculous 
multiplication. Thus "wo balicve” (75±percent) multiplied by “likely” (75± 
percent) would yield odds worse than 3 to Z imstcad of 3 to 1. If we are not 
assigning an odds value to v/e believe” and “we estimate,” the purist would say 

we should not use them. Yet on many. occasions a writer will feel uncomfortable 

and justifiably so— with a hare “It 'is likely tliat 1 Such a bald statement 

is seemingly more confident than the situation would warrant. The WTitcr will 
feel something akin to a compulsion towards modesty and a drive to soften the 
“likely” by introducing it , with a "we believe” : or “we estitjiate,”. .Almost in-, 
variably ho does ndt'intend (;o change tlie odds associated with "likely.” If one 
could set himself up as the arbiter, -one would, I believe, rule that tiie “likely,” 
or tile “probably,” or the “almost; certainly,” etc. was the operative e.vpressioa 
of odds and that its message was unaffected by the introducing verb. 

Doubling up in the “possibly” category i.s a different matter.. We should avoid 
“it might (or may)^ be possible for the Blanks to . . The verb should be ' 
pre^ei;it;6r fnthro ”in'dicalTve. nOnnally ."is''' afld “wiil bm"'-- o' • .5 -..i; 
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For exaiTtiple: 


Possible 


'■'.'Almost certain 


Probable . ... .. , . .... 


50 - 50 ' :.. 


Probably not ’ 


!’ [conceivable 
I could 
. . may 
’ might '. 
perhaps 

Virtually certain , 

. ; ali-.but ccrtam; • •• . '• 'V ' 

highly probable- , ' ' ; 

highly likely 

odds [or chances] overwhelming 
likely 

... , we belieye ■' .■• 

we .«3stiniate . 

I .chances about even y- ... 
chances a littl.e better [or less], 
than even 

.[improbable 

unlikely 

... we believe tliat . . . not 
we estimate that . . . not 
we doubt, doubtful 


These synonyms must not be rnedifled; might well, could well, just could, 
barely conceivable, etc. are as inadmissible as the origimal sin. 

“ “Could” -is included here because of many years’ duty as a synonym for 
"possible.” It has also served as a short way of noting a capability as in iho 
Soviets could develop [for "have tire capability to develop ] such and such a 
radar though \vc have no evidence that they ar.e doing so. The two usages are 
close, to be sure, but not identical. 

“As in, “It is ahnost certain that such and such will occur in the delta, perhaps 
in Saigon itself.” 

“ This group of words poses at least one very vexing problem. Suppose you 
. .."wish '.to .make a .positive esiarnate tnat thrive. is,- say,, about a. 30~'pcrt^nt -chance . 
• lhat such and such' thing is . lire case. Assuming that the thing in question is 
important, a 30-.percent ch.ahce of its being the case is highly significant. If 
you stick with the ciiart and write “it Is improbable [or unlikely -etc.] that such 
and such is the ca.so” you -ivill probably convey a much nioro negative attitude 
than you intend. There are many ways around the problem; they will, however, 
require a- few more words. 
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' Almost certainly not 


almost impossible 
virtually impossible 
some slight chance , 
highly doubtful 


If tlie chart were expanded to lake care of these, it probably would 
. not fit on the inside back cover of the. NIE, and even if it could be made. - 

to, its CDinplexity would probably exasperate gentle reader more than 
it would edify him. Still worse, ho would be confused by clianges 
that would have to be made in it from time to. time, always to ac- 
commodate newcomers among the accepted expressions. 


The table of synony'ms above did not come into being all at once; 
it has grown to its present size by accretion. “.W.e, believe” came in . 
' ratber early, and as I' ferr..ember via General Smith himself. "VvT esti- ' 
mate” was a bit later; “'.ve tliink,” “we e,x].5ect,” and “we judge” are 
. .part way .m.“, ' If they makc.it all the way I tru.st.they wili.be used.' . .. ' 
and understood in the “pfobably”/“we believe" bracket. “We doubt” 
has been accepted within the last few years as a legitimate equivalent ■ . 
of “probably not.” There m'll be other.s — I sincerely hope not very 
•many. Keeping them out will take some doing. In the past, what- 
ever the rigor insisted upon at tlie working and clrafting level, who was 
there to tell a General Smith or a Mr. Dulles, as he presided over the 
lAC or USIB, that the revision he had ]u.st \mtten out on a, piece of 
yellow paper was not permissible? ' . . 




Consistencij in Usage ' . 

From my remarks about the poets, it should be clear that my sym- 
pathies lie with their mathematical opponents. But we inathcmati- 
cally’-inclined are ourselves not in good array. You might almost say 
that some of us are talking in the decimal, others in the binary, and 
still others in the root five or seven systems. 

For example, consider the letter-number device which has been 
standard with attache and other reporting services, A-2, C-3, F-6, etc. 

‘The numbers 1, 2, 3, 4,'S, and 6 designating the quality of a report’s 
content stand for, respectively: (1) confirmed by other independent 
or reliable sources; (2) probably true; {3) ■ pos.sibhj true; (4) doubt- 
ful; (5) probably false; and (6) cannot.be judged. Note that the 


'. • .. “Wc antidpato," used regrettably as a-'syno.nym for: ‘‘vfe; .expect,’! is aUo.part '.'.’;'.— .,:- 

' '''wtiy in." -liiope it gets' out.’ ' . ' 
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number 3, “possibly true,” is in the rhicldlo of the scale of odds, doing 

the duty I have hoped it should never be asked to do. 

Or consider the findings of a distinguished intelligence research 

project. The object was to identify certain military units with respect 

to the chances of their existence or non-existence. One group of units 
was called “firm,” another “highly probable,” a thirci probable, and 
a fourth general group “possible.” Except for one important thing, 
this kind of ordering was wholly to my taste. The word ‘firm was 
.■ . . .unfortunately not used, . as one might, expect, to describe , a , condition 
■ " . fef 100 percent certainty. ; Its begetters,- upon cross-examination,' owned 
that it was . meant to indicate something, like '90.-95 percent— roughly 
the equivalent of my “almost certain. This usage prits the lower 
. categories slightly askew from the terminology of my chart— highly . 

probable” equating to my “probable” and probable to my chances 
' better than even.” .“Possible," hoxyever, was used exactly as I have felt . 

.- :,.'it should be used, td designate something in the range of chances be-:; - • ■ 
tween the absolute barr.iers of “certainty and, impossibility to which 
no numerical odds could be assigjied. . . . -• . .. 

■b’-'vk There' are other liei'esies among the matheftiaticia'ns, if they' catl-be. so' ' 
... proclaimed. For example, look at the way in which photo-interpreters 
have defined their key -evaluative v.’ords:, . ' 




Suspect — Evidence is insufFieient to permit designation of a function with 
any degree of certainty, but photography or other information provides some 
indications of what the function may be. 

Possible — Evidence indicates that the designated function is reasonable 
and more likely than c-ther, functions considered. . . , 

Probable — Evidence for the clesignatt-d function is strong and other func- 
tions appear quite doubtful. 

This kind of formulation shows that someone — probably a number 
of people. — had spent a good amount of time striving for a set of 
rigorous definitions. It you pause long enough to realize that the 
photo-interpreter’s first problem’ is identification and then take a liard 
look at his word “suspect,” you will sec that it parallels my usage for 
“possible.” But the P/Is have preempted "possible” for other duty. 
Their "possible” fits nicely into the slot of "probable” in my scale of 
values, and their "probable” into my “almost certain.”' 

We are in disarray. 




To Estimate or Not' 


The green language of ordinary conversation abounds with estimates 
given lightly and with a high order of confidence: “You’re a shoo-in,” 
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"Not a Chinaman’s chanoe,” "A million to one.” When you hear one of 
these expressions or read its more decorous counterpart you may realize 
that the matter at issue and the related judgment required little soul- 
searching on the part of the estimator. In the intelligence business, 
too, there are many occasions when the obscurities of the unknown are 
easily pierced and we can launch an estimative “probably” or an 

almost certainly not with speed and conviction. 

. • '■ There .are, however; . estimates' at the other' end of the 'spectrum-ii'' 
estimates which are patently impos.sible to make. The green language 
IS equally ridi in coping with these; “Search me,” “I wouldn’t have 
the foggiest, our guess is as good as mine,” and so on, 

, It is unfortunate that intelligence estimators are not allowed this kind 
of freedom in brushiiig off requests for estimates of the totally im- ' 
penetrable . Some way. or. anotlier.-a .convention, has. been established.' ■ 

• by-.xvhreh.we may .notv.Titc the. sentence: “It .-is impossible, to estimate., 
such^and suc;h.’’ If we try this maneuver our masters will often rudely 

. .-^sk Why ,c.an’.t;you; what are you paid for, anyway?” If they do not' ■ 

■ bludgeon us thus, .they employ a combination of blackmail aiid flat- ' 
to)’ before which even tlie most righteous among us are .likely to fall. ' 

• The play goes like, this.; .“You bsay vou cannot. ■.estimate ..thb'.,' number; 
t}-pe, and perfo-rmance cliaractcri.stics of Chinese Communist ]olw^ 
range missiics for mid-1970. This is data which is absolutely essential 
tor my planning. Obviously no one expects you to be wholly accurate 
or yciy confi^lent of your'findings. .But-you people are after all the-' • 
experts, and it would be too bad if I had to go to others for this stuff 
who know far less about it than you. And that is exactly what I will 
do if you refuse my request.” 

^ At this point we do not invite our would-be consumer to seek out 
ms own crystal ball team. We accept his charge, but with grave 
reservations. ^ Sometimes we try to stay honest by introducin'^ con- 
tingencies. Tins will probably continue to be the case but only 
if . - if . . . , and if. . . ."■ Then without closing out the contingencies ' 
with firm estimates (which we are plainly unable to make) we merely 
talk about the “ifs,” hoping that he will keep them in mind as time 
unfolds and that .when sufficient returns . are in he will himself make 
. tile estimate or ask us. to have a second look. 

At other times again, v'hen it is the whole subject rather than one 
of its parts tliat cannot be estimated, wc meet the impossible frontallv^ 
We scrupulously avoid the word “estimate” in de.scribina tlic docu- 
ment and it.s' findings. Rather, wc proclaim these to be Intelligence 
assu.rnptjon.s.,(qn pla^ •./.n- oin, o^jciiing paragraphs '\ve '.arc likely • 
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to be quite specific as to where our evidence begins and ends, ho%v 
we are speculating about quantities of tilings that tlie other man may 
produce witliout knowing whether he has yet made the decision to. 
produce so many as one. We acknowledge our use of tlie crutch of 
U.S. analogy, and so on, Wc promise to speak, not in discrete figures, 
but in ranges of figures and ranges of our uncertainty regarding them. 

Some years back we were obliged, by force inajeur to compose some 
tables setting forth how the . Blanks might divide up an all-but- 
undreamed-of stockpile of fissionable malci ial among an as-yet-unborn 
family of wcapoirs. There were of course the appropriate passages 
of verbal warning, and then, 'bn the chance that' the numerical tables- 
should become plp'sicallv sciiarated from the warning, the tallies were 
overprinted in red, “This table is based on assumptions stated in. . . . 
Moreover, it should not bo used for any purpose whatever \Yithout 
inclusion, in full, '■of the cautionary material ini ■. . More recently ' 
wc have issued a document which not. onl)' began willi a fulsome 
caoeat.hut was set. off by. a fopnat.and- color of paper. ih;a,t were new,_, 
departures. .' ' 


■ The Lurking Weasel 



Unhappily, making the easy estimate, is not the commonplace of 
Our trade; making the impo.s.sible one is happily equally rare. What 
is the commonplace is the difficult but not impossible estimate. And- 
how we, along with all humanity, liate the taskl flow fertile the 
human mind in devising ways of delaying 'if not avoiding the moment 
of decisionl IIow rich the spoken language in its vocabulary of issue- 
ducldng! “I liave a' sneaker that . . . /’ “I’d drop dead of surprise 
if . . — expressions with sound but upon reflection almost without 

meaning. How much conviction, for ex.ample, do you have to have 
before you become possessed of a. sneaker; how much of the unex- 
pected docs it take . to cause your heart to fail? . 

Even the well-disciplined intelligence brotherhood similarly quails 
before the difficult but not impossible estimate and all too often resorts 
to an exjrression of avoidance drawn from a more elegant lexicon. , 
What we consciously or subconsciously seek is an expression which 
conveys a definite meaning but at the same time either absolves us 
■completely of the responsibility or makes the estimate at enough re- 
moves from ourselves as not to implicate us. 'I'hc “seriou.s [or distinct] 
possibility” clan of e.xpressions is a case in point. 
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Look at our use of “apparently” and “seemingly’’ and the verbal 
appears and seems. W’e, the writers, are not the unique beings 

to whom such and such “appears” or “seems” to be the case; with these ■ 

j words we have become everybody or nobody at, all. So also Wiili 

i “suggests” and “indicates.” Perhaps the “to us” is implicit, but we do 

‘ SO state, and fai more imp)orlantly, we practicallv never say why 

j ■ oiu suggestibilities were aroused or assess the weight of the reason 
I that aroused them. So still again with "prcsinnaldy,”. "ostensibly," . 

! :., ■• •• serious of all — reportedly” otherwise unmodified. The- ' 

• ■ latter, taken literally and by itself carries no evaluative weight wliat- 

soever, and who should know this better than we ourselves who each 
day- handle scores of reports” whose crcdibilitv runs up and down 
the scale between almost certain ■ ti'uth and almost certain nonsense. ■ 

. . ' It is' a pleasure to report~auiboritatively---tliat you will find very few 

unmodified “reportedlys” in the NIEs. 

■ ’ Wp say the Soviets probably /ert/' .that-- such, and such action -.-will i 

' hf eV-t "' ■ - cause 'thus and -so.” Vi'hat I think we mean is “d'ho Soviets proliably 

' 1- ..' ....■.-^stiniate that if they dp such and .such die. reaction , -will. -be disadvam j '-. . 
i ■ ’ tageouS to- them.” If we say “they probably /mpe . . we mean 

^ ^tiugbly the opposite. We talk of another counlrv’.s willingnc.ss “to 

^ j .. -... risk such and such. this is a shorthand, and. probably an. unconscious - ' 

■1 dW' -i- ,- j one, for the country’s having estimated die odds areiinst llie un^\-aiited 

^ thing s ■ liappcning as wcil as how unacccpitabic the unwanted thing 

woiihi be if it occurred. Its risking the danger” removes the critical ■ 

I , judgment a .step or two from our personal responsibility. / 

Words and expressions ii'k-e these are far -too much a part of ms and 

our habits of communication to be banned by fiat. No matter what 
is said of their impreciseness or of the timiclity of soul that attends 
their use, tliey will continue to play an important j-iart in written. e.x- 
pression. If use them we must in NIEs, let us tr_\' to use them sparingly 
and in places where they are lea.st likely to obscure the tlirust of mir 
key estimative passages. 

Here may I return to the group to which I have especially addressed 

the foregoing— the brotherhood of the NIE. Let us meet the, sc: key 
estimates head on. Let us isolate and seize upon exactly the tluim 
h - .uGeds - estimating. -, i.et us endeavor' to make clear to did reader V ’ ' , 

. - h - die passage in' question is of critical importance — (he gut estimate, 

, as we call it among oui-.s-clvcs. Imt us talk df it in terjns of odds or 
chancc.s, and when we have made our best judgmcait k:t us as.sisyi it a 

‘ - d^ord or plirase .that is chosc-n from one of the five rough calegoVdes of 
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likcliKood.on llic chart. Let the judgment be unmistakable and let 
it bo unmistakably ours. i- ■ 

If the matter is important and cannot jbe assigned an order of likeli- 
hood, but is plainly something which is neither certain .to come about 
nor impossible, let us use the svord “possible” or one -of its stand-ins 
• and with no modifier. 
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